Genetic Approach for Optimizing Ensembles of Classifiers
نویسندگان
چکیده
An ensemble of classifiers is a set of classifiers whose predictions are combined in some way to classify new instances. Early research has shown that, in general, an ensemble of classifiers is more accurate than any of the single classifiers in the ensemble. Usually the gains obtained by combining different classifiers are more affected by the chosen classifiers than by the used combination. It is common in the research on this topic to select by hand the right combination of classifiers and the method to combine them, but the approach presented in this work uses genetic algorithms for selecting the classifiers and the combination method to use. Our approach, GA-Ensemble, is inspired by a previous work, called GA-Stacking. GA-Stacking is a method that uses genetic algorithms to find domain-specific Stacking configurations. The main goal of this work is to improve the efficiency of GAStacking and to compare GA-Ensemble with current ensemble building techniques. Preliminary results have show that the approach finds ensembles of classifiers whose performance is as good as the best techniques, without having to set up manually the classifiers and the ensemble method.
منابع مشابه
Feature Selection for Ensembles: A Hierarchical Multi-Objective Genetic Algorithm Approach
Feature selection for ensembles has shown to be an effective strategy for ensemble creation. In this paper we present an ensemble feature selection approach based on a hierarchical multi-objective genetic algorithm. The first level performs feature selection in order to generate a set of good classifiers while the second one combines them to provide a set of powerful ensembles. The proposed met...
متن کاملLearning to Assemble Classifiers via Genetic Programming
This article introduces a novel approach for building heterogeneous ensembles based on genetic programming (GP). Ensemble learning is a paradigm that aims at combining individual classifiers outputs to improve their performance. Commonly, classifiers outputs are combined by a weighted sum or a voting strategy. However, linear fusion functions may not effectively exploit individual models’ redun...
متن کاملGenetic Programming of Heterogeneous Ensembles for Classification
The ensemble classification paradigm is an effective way to improve the performance and stability of individual predictors. Many ways to build ensembles have been proposed so far, most notably bagging and boosting based techniques. Evolutionary algorithms (EAs) also have been widely used to generate ensembles. In the context of heterogeneous ensembles EAs have been successfully used to adjust w...
متن کاملAn Approach for Assimilatiion of Classifier Ensembles on the Basis of Feature Selection and Diversity by Majority Voting and Bagging
A Classifier Ensemble (CE) efficiently improves the generalization ability of the classifier compared to a single classifier. This paper proposes an alternate approach for Integration of classifier ensembles. Initially three classifiers that are highly diverse and showed good classification accuracy when applied to six UCI (University of California, Irvine) datasets are selected. Then Feature S...
متن کاملEvolutionary Ensembles: Combining Learning Agents using Genetic Algorithms
Ensembles of classifiers are often used to achieve accuracy greater than any single classifier. The predictions of these classifiers are typically combined together by uniform or weighted voting. In this paper, we approach the ensembles construction under a multi-agent framework. Each individual agent is capable of learning from data, and the agents can either be homogenous (same learning algor...
متن کامل